Gary Oldman Says He Broke Down Physically After Ex-Wife's Comments